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METHOD AND APPARATUS FOR NAVIGATING A WINDOWED OPERATING 

ENVIRONMENT 

TECHNICAL FIELD 

The invention relates to a method of navigating a windowed 
operating environment without using a conventional pointing 
device. More particularly, the present invention relates to an 
interface system that permits a handicapped or any other 
individual to operate a system for positioning a pointer and 
clicking a selection button on a computer display screen without 
having to move a mouse, trackball or other type of input device. 

BACKGROUND OF THE INVENTION 

Various special purpose systems have been developed which 
use surface or implanted electrodes to allow primarily 
handicapped individuals to control prosthetic devices such as 
artificial limbs. For example, Graupe in U.S. Patent 4,030,141 
describes a method for actuating a prosthetic device from a 
single pair of electrodes. The electrodes provide 
electromyographic (EMG) signals which are processed and delivered 
to a control circuit for electrically activating a prosthetic 
appliance . 

Harris in U.S. Patent 4,711,027 describes a method of 
constructing a fluid tight assembly of an electrode along the 
length of an implantable lead. Soukup et al. in U.S. Patent 
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5,609,622 describe another type of implantable electrode shaped 
as a helically wound conductor. Testerman et al. describe an 
implantable eyelid electrode. However their electrode is used 
for stimulating eyelid motion in a person having hemifacial 
paralysis . 

Crawford, Jr. in U.S. Patent 4,158,196 describes a system 
for converting bioelectric activity, EMG signals, to serve as an 
input to a computer, microprocessor, discrete logic network or 
any system using digital input signals. The system also converts 
digital signals into electrical stimuli which are applied to a 
second set of electrodes. A control unit uses the sensed and 
stimulated signals for controlling a wheelchair. 

In a different approach, Teltscher in U.S. Patent 3,986,030 
describes a method for selecting keys of a typewriter or keys of 
a piano. Light rays reflected by eye motion activate light 
responsive sensors. With this system someone e.g. a 
quadriplegicly affected person can operate the keys without 
movement of arms or legs. 

None of the aforementioned devices and methods, however, 
addresses navigating a window environment which is normally 
accomplished by moving a mouse or trackball device. 
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In accordance with the teachings of the present invention 
there is defined a new method and apparatus for navigating a 
windows environment without use of a mouse or trackball device or 
the like. It is believed that such a method and apparatus would 
constitute a significant advancement in the art. 

OBJECTS AND SUMMARY OF THE INVENTION 

It is therefore a principal object of the present invention 
to enhance the window navigation art by providing a system with 
enhanced capabilities. 

It is another object to provide such a system wherein 
enhanced operational capabilities are possible. 

It is a further object of the invention to provide a method 
of navigating a window environment which can be accomplished in 
an enhanced manner. 

These and other objects are attained in accordance with one 
embodiment of the invention wherein there is provided a system 
for navigating in a window environment, comprising, a processor 
having a display, and window environment software installed on 
the processor, a sequential digital control circuit coupled to 
the processor, the control circuit adapted to positioning a 
pointer and making a selection within a window on the display in 
response to input circuits, and a plurality of the input circuits 
coupled to the digital control circuit, the input circuits 
adapted to receive electromyographic signals. 
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In accordance with another embodiment of the invention there 
provided a navigating apparatus, comprising, a processor having a 
display, and window environment software installed on the 
processor, a sequential digital control circuit coupled to the 
processor, the control circuit adapted to positioning a pointer 
and making a selection within a window on the display in response 
to input circuits, a plurality of the input circuits coupled to 
the digital control circuit, the input circuits adapted to 
receive neurotropic electrode signals, and a chip having a 
plurality of neurotropic electrodes, the chip connected to the 
plurality of the input circuits. 

In accordance with yet another embodiment of the invention 
there is provided a method of navigating within a window 
environment, the method comprising the steps of, displaying a 
pointer within a window on a processor display attached to a 
processor, the processor running window environment software, 
receiving a plurality of electromyographic signals by a plurality 
of input circuits coupled to a sequential control circuit, 
whereby the control circuit is coupled to the processor, and 
operating the sequential control circuit in response to the 
plurality of input circuits to position the cursor or make a 
selection within said window. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



FIG. 1 illustrates the various elements of a navigating 
system; and 

FIG. 2 shows one embodiment of operation of directional 
navigation and selection by a control circuit as used in the 
navigation system. 

BEST MODE FOR CARRYING OUT THE INVENTION 

For a better understanding of the present invention, 
together with other and further objects, advantages, and 
capabilities thereof, reference is made to the following 
disclosure and the appended claims in connection with the above- 
described drawings. 

In FIG. 1 there is shown a system 10 for navigating in a 
window environment. The term navigating shall be taken herein to 
mean movement or positioning of a pointer on a display and making 
a selection of an item on the display that is located at the 
current position of the pointer. The pointer may be positioned 
anywhere on the display whether within or outside defined window 
area. Processor 12 has a display 14 and has window environment 
software installed. The processor may be any type of computer, 
mainframe, desktop, tower, laptop, palmtop or other type of 
computing device or microprocessor capable of running window 
environment software and operating display 14. The software may 
be an operating system having a graphical user interface (GUI) . 
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It may also be a graphical or drawing software application 
installed on processor 12 . 

Display 14 may be an integral part of processor 12 such as 
the display of a laptop, palmtop, cellphone or other computing 
device, more typically display 14 is mounted in a separate 
mechanical structure attached to processor 12 via cable 20. A 
windows environment is shown 16 on the face of display 14 
including a moveable pointer 18. A person 22 is positioned 
within viewing distance of display 14. 

The person 22 may be a handicapped individual who can 
observe but has no ability to operate a mouse or other pointing 
and selecting input device in order to navigate the window 
environment shown on display 14. Person 22, however, may be any 
individual, whether handicapped or not, who desires to navigate 
the window environment. 

A surface or implanted electrode 24 is located on or within 
person 22. The electrode may be adapted for receiving 
electromyographic signals generated on or within person 22. The 
signals are within the conscious control of the person so as to 
be activated and deactivated at will. Electrodes may be located 
on any part of the body of person 22 including skin, brain, 
muscle tissue or eyelid etc. 
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Electrode 24 may comprise a chip implanted in the brain 
having neurotropic electrodes capable of receiving signals 
generated through mental processes such as thought, by person 22. 
In one embodiment a two signal chip comprises two neurotropic 
electrodes on a chip structure capable of providing two signals. 
Person 22 may activate either of the signals. In the case of 
electrode 24 positioned in muscle tissue, person 22 may activate 
a signal by consciously flexing or relaxing the muscle. 

Electrode 24 is connected via connection 2 6 to an input 
circuit of control circuit 28. Connection 26 may be an electrical 
connection using any electrically conductive wire material. It 
may also be any other apparatus or device for transferring 
signals from electrode 24 to control circuit 28. The input 
circuit typically samples, amplifies, and converts the 
electromyographic or neurotropic type signals to produce digital 
signals for use by a sequential digital control circuit of 
control circuit 28 which is coupled to processor 12 via 
connection 30. 

The input circuit may also be configured to filter out 
repeated signals within a pre-specif ied time such as might be due 
to a lack of signal creating dexterity of a handicapped person. 
In addition to amplifying, the input circuit may also provide 
thresholding and signal processing of the signal generated by an 
electrode. The input circuit may also measure or process the 
duration of a signal or the time period between activated 
signals. The input circuit may also be constructed to operate in 
an adaptive manner to adjust the thresholding and signal 
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processing automatically and thereby adapt over time to 
particular electromyographic or neurotropic signals. 

The operation of the sequential digital control circuit can 
best be explained with reference to FIG. 2. In the case where 
person 22 may activate one of two signals, the first signal 
advances an indexer 40 as shown in FIG. 2 by one for each signal 
received. For example, position 1 (move up) could be a starting 
point. Activating the first signal one time advances the index to 
position 2 (move right). After reaching position 4 (move left), 
another first signal advances the index to position 5 (select 
position) . Thereafter another first signal resets the index to 
position 1. 

Activation of the second signal causes a cursor movement or 
selection which is dependent or the current position of the index 
as explained on Table 1. below. 
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Index 


Effects of each 
Signal 1 received/ 


Effect of each 
Signal 2 received 


Position 1 


Advance to Position 2 


Move mouse cursor up 
a predefined number 
of pixels, or to the 
next logical 
predefined up 
position 


Position 2 


Advance to Position 3 


Move mouse cursor 
right a predefined 
number of pixels, or 
to the next logical 
predefined right 
position 


Position 3 


Advance to Position 4 


Move mouse cursor 
down a predefined 
number of pixels, or 
to the next logical 
predefined down 
position 


Position 4 


Advance to Position 5 


Move mouse cursor 
left a predefined 
number of pixels, or 
to the next logical 
predefined left 
position 


Position 5 


Advance to Position 1 


Make a selection on 
current pointer 
position . 



Table 1. 
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The effect of each second signal activation will be observed 
by person 22 as the action affects the image presented on display 
14. Means for indicating the current index position may be 
provided by various indications such as an arrow, or color dots, 
or the like also on display 14. Alternatively an index 
indication may be included in control circuit 2 8 without 
departing from this invention. 

In the embodiment described above, control circuit 28 is 
adapted to respond to two input circuits. The response to the 
first input circuit is used for directional navigation and the 
second for selection of movement in the respective direction or 
selection comparable to a mouse click at the current position of 
a cursor 18 in window 16. Cursor 18 could also be located 
anywhere on display 14. 

The above description of one embodiment of control circuit 
2 8 is not intended to be limiting. Those of ordinary skill in 
the art will recognize that additional movement or selection 
states may be readily included in the indexer 40. For example, 
six, eight, ten or any number of directions may be included. 
Additional selection positions may also be included. For example 
one selection position may make a single click selection, another 
selection may be used for a double click selection, and a third 
selection position used for a right button selection. 
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Central circuit 28 performs the actions just described in a 
sequential digital control circuit which may comprise hardware 
logic circuits of any circuit family. A programmed 
microprocessor may also be used. Furthermore the program may be 
stored and executed in processor 12 without departing from the 
present invention. 

Control circuit 28 may be coupled to processor 12 via any 
type of interconnection including but not limited to a keyboard 
or mouse port, serial port, bus interface, or infrared port. 
Processor 12 may run specially developed software as noted above 
to complete the cursor positioning and selection making on screen 
14. 

The person 22 may therefore navigate a window environment 
through activation of signals and observing the result on display 
14 while using input circuit 28, and processor 12. As with any 
new system, a certain amount of time and effort may be needed for 
person 22 to learn how to operate the system and become 
proficient in its use. Specialized learning software may be 
provided in processor 12 to assist in the learning process such 
as practice drills in turning the signals on and off. 

While there have been shown and described what are at 
present considered the preferred embodiments of the invention, it 
will be obvious to those skilled in the art that various changes 
and modifications may be made therein without departing from the 
scope of the invention as defined by the appended claims. 
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